Background separated images for print and on-line use

ABSTRACT

In embodiments of the present invention improved capabilities are described for producing background separated product images for print and on-line display. An image formation system provides lighting of a product to facilitate acquiring images that can be automatically processed to generate high resolution item-only images free of quality defects and imaging artifacts. Image processing programs accurately detect an outline of an item in a set of digital images taken using the image formation system and automatically store processed images in an image library. The images in the library may be repurposed for print, sales display, transmission to a user, on-line customer support, and the like. A user display configured with an adaptable user interface facilitates user interaction with images in the library.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of the following provisionalapplication that is hereby incorporated by reference in its entirety:

U.S. Provisional App. No. 60/824,571, filed on Sep. 5, 2006.

BACKGROUND

1. Field

This application relates to illumination fixtures and in particular toilluminating an item to facilitate providing background separatedimages.

2. Description of the Related Art

Images of products for advertising or other purposes are prevalent inprint and on-line content. Advertisers prefer to use high quality imagesof products in advertisements to differentiate their products.Additionally a high quality product image can convey criticalinformation about a product much more quickly than a text descriptioncan. Attributes of high quality images for advertising include excellentimage details, clear product edges, the absence of a visible background,(thereby conveniently allowing use of the image in various contexts,such as print advertisements, web advertisement, or the like), and anabsence of defects such as spots, reflections, or specular highlights.To achieve high quality product images, advertisers conventionally usephotography studios that employ specialists who are experts ingenerating high quality images of products.

While some functions related to high quality photography may benefitfrom digital image processing, such as red-eye removal, achievingexcellent image details with clear product edges and no visiblebackground typically requires manual manipulation of the images,including clicking along segments of the edges of an object on acomputer screen to define an outline of the object so that the objectcan be separated from its background. Additionally, providing highquality images for processing requires time intensive product placement,lighting, and photography with each change in product positioning oftenrequiring adjustments to lighting. Once high quality product images arecaptured, specialists use manual graphic editing tools to separate theitem from its background so that the item can be repurposed for varioustypes of advertisements. As with most high quality detailed manualfunctions, the process is often time-consuming and costly, requiring askilled and well trained specialist. Unfortunately, the cost ofoperating a photography studio of such specialists is passed on to theadvertiser through high fees. To achieve improved throughput orincreased capacity, additional specialists must be employed and theircost is also passed onto the advertiser. Since each image must bemanipulated individually due to any change in lighting or viewing angle,creating a library of images that show multiple features or views of aproduct can be very expensive.

In embodiments, a photograph or digital image as described herein may betaken with lighting configured to deliver a high quality image of theobject without consideration for the critical manual operation ofseparating the object from its background. In some cases, when taking aphotograph, an outline of an object may be inadequate to ensure that theability to separate the object from its background is of similarly highquality. Additionally, lighting in a photography studio may be optimizedfor lighting an object and may be inadequate to illuminate the objectfor the purpose of efficiently separating it from its background. As aresult using a single image of an object illuminated for purposes of ahigh quality image can compromise a step in delivering an object imagesuitable for advertisers' purposes. Alternatively, the photograph ordigital image may be taken in a way that compromises between obtaining ahigh quality image of the object and obtaining an image from which thebackground may be separated. In such a case, neither the quality of theimage nor the quality of the separation of object from background isoptimized.

Users of the Internet have come to expect on-line shopping to facilitatea superior understanding of a product before a purchase is made. Highquality product images provide a high degree of information that isimportant to a consumer. While user interface interactive capability anddynamic displays are common aspects of today's personal computers usedfor on-line shopping, cost and schedule limitations of generating thenecessary library of product images severely limits the extent to whichon-line advertising can take advantage of these aspects. On-lineconsumers are often limited to a few views of the exterior of a productand do not get the opportunity to virtually interact with the productprior to purchase. As a result, consumers are either making purchaseswithout sufficient information, or are using up a product supplier'ssupport resources for answers to product specific questions they cannotget answered through their on-line shopping experience. However, on-lineadvertising, product display, and on-line shopping are especiallyattractive to both sellers and consumers due to the low cost of sale(and the resulting reduction in consumer price) and to consumers due tothe access to information.

Therefore, there exists a need to quickly and cost-effectively generatea wide range of product images for each product to facilitate theenvisioned on-line shopping experience and the resulting sales costadvantage. There also exists a need to deliver the images to on-lineusers in an interactive display format that facilitates easy access tothe features, capabilities, and other aspects of a product necessary tomake a well-informed buying decision.

SUMMARY

An aspect of the invention herein disclosed may include an imageformation and processing system for delivering high quality productimages with no visible background. This aspect may be achieved by usingautomated image processing to generate and repurpose the product images.

An advantage of this aspect of the invention may address key drawbacksof known methods and systems such as per image cost and processing time.By automating key activities while achieving higher quality productimages, the methods and systems herein disclosed may dramatically lowerper image cost while providing greater throughput and higher capacity ofthe high quality images. This may result in facilitating the developmentand management of a library of product images that can be used tofulfill a wide variety of product display and advertising needs.

Another aspect of the invention herein disclosed may include a userdisplay and interface to facilitate a user manipulating a productdisplay. An advantage of this aspect of the invention may includefacilitating a user to virtually touch, turn, operate, open, tilt,activate and observe a product, and retrieve more information (e.g.detailed images, text, audio description). The interface may also allowuse of game controllers or virtual reality interface devices.

The elements of the invention herein disclosed may address key aspectsof a consumer purchasing process. With the invention, the consumer mayview a preferred model, rather than the one on display at a local store.Details of a product, both internal and external may be easily viewed.In addition to the product, the box contents (e.g. manuals, includedaccessories, assembly instructions) may be available to be viewed by theconsumer. Additionally, the invention facilitates providing the imagesand an interactive user display to deliver a rapid, automated responseto a customer product query. This may result in a faster sales cycle. Inembodiments, the invention may be combined with on-line sales supporttools that explain product features, virtually demonstrate the product,answer frequently asked questions through images as well as text oraudio, and allow a consumer to examine and evaluate a product without atime limit such as may be imposed in a physical store. Similarly, theimages and interactive user interface may be beneficial to customersupport organizations to guide users through debugging, assembly,accessory installation, and home servicing of products. A user may viewan interactive display of installing a replacement component rather thanviewing a hard copy printout of static images typically included in aproduct manual. The invention could be used to provide interactiveimages quickly in reply to a customer request for support of an aspectnot already available.

In an aspect of the invention, a method for producing a backgroundseparated image, includes acquiring at least two images of an item and abackground with a camera, wherein one of the at least two imagesprovides high contrast between the item and the background; processingthe contrast image to detect a separation between the item and thebackground, providing an edge mask; aligning the edge mask with theboundary of the item in the other of the at least two images; extractingthe other image content within the aligned edge mask to produce anitem-only image; and storing the item-only image in an image library.

In the method, the background is illuminated. The illumination may beuniform such as uniform in color or intensity. The illumination may bediffuse.

In the method, the background is illuminated from a side opposite theitem.

In the method, the background material is textured plastic or a lightdiffusing film on a glass substrate.

In the method, the camera is a digital camera. The digital camera mayhave a resolution of at least 2000×2000 pixels, or it may be a digitalvideo camera.

In the method, acquiring further includes configuring a plurality ofcamera settings for each of the at least two images wherein at least onecamera setting is different for each of the at least two images.

In the method, the processing the contrast image is performedautomatically by an image processor.

In the method, the processing is performed by an image processorexecuting a combination of standard and custom image transfer andprocessing software. The processing may include identifying a set ofpoints of the background that are adjacent to a set of points of theitem.

In the method, the background of the contrast image is substantiallybrighter than the item. The item of the contrast image is substantiallyblack. The edge mask is an image comprising the item boundary. The edgemask may be a list of vectors in a two-dimensional coordinate space or alist of points in a two-dimensional coordinate space. Each of the atleast two images reference a common origin in a two-dimensional space.The edge mask is referenced to the common origin so that the edge maskcan be automatically aligned to the item in the other image of the atleast two images.

In the method, aligning includes using an edge detection algorithm toidentify a plurality of edges of the item in the other image of the atleast two images and fitting the edge mask to the detected plurality ofedges.

In the method, extracting includes deleting all content of the otherimage of the at least two images image other than the content within thealigned edge mask. Deleting may include changing content to white, ormarking the content as deleted.

In the method, extracting includes selecting all image content withinthe aligned edge mask and copying the selected image content to a newimage, providing a new image containing only the selected content.

In the method, the method further comprises removing image defectsselected from a set consisting of product surface blemishes, dust, andspecular highlights.

In the method, the item may be a product, or an accessory such asproduct packaging, an owner manual, a warranty certificate, a cable, acontroller, or a data storage disk.

In the method, the item is one or more assembly parts such as screws,nuts, bolts, wire, wire fasteners, wrench, screw driver, and nut driver.

In the method, the item is a product for sale such as an on-lineauction, an on-line purchase, a telephone purchase, an in personpurchase, or a mail-order purchase.

In the method, the item is for rent.

In another aspect of the invention, a system for producing a backgroundseparated image, includes a camera for acquiring at least two images ofan item and a background, wherein one of the at least two imagesprovides high contrast between the item and the background, providing acontrast image; an image processor for processing the contrast image todetect a separation between the item and the background, providing anitem edge mask, wherein the edge mask is aligned with the boundary ofthe item in the other of the at least two images, and the other imagecontent within the aligned edge mask is extracted, providing anitem-only image; and an image library for storing the item-only image.

In the system, the background is illuminated. The illumination may beuniform, such as uniform in color or intensity. The illumination may bediffuse.

In the system the background is illuminated from a side opposite theitem. The background material may be textured plastic or light diffusingfilm on a glass substrate.

In the system, the camera is a digital camera. The digital camera mayhave a resolution of at least 2000×2000 pixels or may be a digital videocamera. The camera includes a plurality of camera settings wherein atleast one of the plurality of camera setting is different for each ofthe at least two images.

In the system, the image processor is an image processor executing acombination of standard and custom image transfer and processingsoftware

In the system, the background of the contrast image is substantiallybrighter than the item. The item of the contrast image is substantiallyblack.

In the system, the edge mask may be an image comprising the itemboundary, a list of vectors in a two-dimensional coordinate space, or alist of points in a two-dimensional coordinate space.

In the system, the at least two images include a common origin in atwo-dimensional space. The edge mask includes the common origin so thatthe image processor can automatically align the edge mask to the item inthe other image of the at least two images.

In the system, an edge detection algorithm to identify a plurality ofedges of the item in the other image of the at least two images and aboundary matching algorithm for fitting the edge mask to the detectedplurality of edges. In the system, algorithm are further included forone or more of deleting all content in the other of the at least twoimages that is not within the aligned edge mask, changing to white allcontent in the other of the at least two images that is not within thealigned edge mask, and marking as deleted all content in the other ofthe at least two images that is not within the aligned edge mask.

In the system, the item-only image includes only the image contentwithin the aligned edge masked

In the system, an algorithm is included for correcting image defectssuch as product surface blemishes, dust, and specular highlights.

In the system, the item may be a product, or an accessory such asproduct packaging, an owner manual, a warranty certificate, a cable, acontroller, or a data storage disk.

In the system, the item is one or more assembly parts, such as screws,nuts, bolts, wire, wire fasteners, wrench, screw driver, and nut driver.

In the system, the item is a product for sale such as an on-lineauction, an on-line purchase, a telephone purchase, an in personpurchase, a mail-order purchase.

In the system, the item is for rent.

In another aspect of the invention, a method of accumulating a set ofitem-only images of an item comprises providing a camera for acquiringimages of an item; providing an illumination fixture for illuminatingthe item; acquiring a plurality of images of the item from differentperspectives, wherein the item is illuminated by the fixture;automatically processing each of the plurality of images to generateitem-only images; and associating the set of item-only images in animage library for presentation to a user.

In another aspect of the invention, a method of presenting item-onlyimages comprises providing a set of item-only images of an item;selecting at least one item-only image; combining the at least oneselected item-only image with a background, providing an repurposedimage; and receiving an item request from a user, and in responsethereto presenting the repurposed image to the user.

In the method, selecting at least one item-only image is based at leastin part on the item request.

In the method, the method further comprises receiving a request from auser to adjust a perspective view of the item and in response thereto:selecting a second item-only image from the set of item-only images;combining the second item-only image with a background, providing aperspective item image; and presenting the perspective item image to theuser.

In the method, the item display image is presented to the user in one ormore of an on-line product purchase activity or an on-line productsupport activity.

In the method, the item-only image includes a representation of aninterior of a product.

In the method, the background includes one or more of icons thatrepresent aspects of the item. Selecting one of the one or more iconspresents the aspect of the item. The aspects selectable through the oneor more icons include an internal view of the item, a manual, one ormore accessories, assembly instructions, product packaging, serviceplans, peripherals, and alternate configurations of the item.

In another aspect of the invention, a method of customer supportcomprises: receiving a support request from a user; acquiring one ormore item-only images of an item identified in the support request;repurposing the one or more item-only images for presentation to theuser; and providing the repurposed images to the user as a response tothe support request.

In the method, the support request is selected from a list consisting oftrouble shooting, assembly, accessory installation, home service,upgrading, and returning the item.

In the method, providing the repurposed images includes one or more ofdisplaying the repurposed images on a computer, rendering a videocomprising the repurposed images, printing the repurposed images,sending the repurposed images as an email attachment, posting therepurposed images to a web site, storing the repurposed images on aserver.

These and other systems, methods, objects, features, and advantages ofthe present invention will be apparent to those skilled in the art fromthe following detailed description of the preferred embodiment and thedrawings. All documents mentioned herein are hereby incorporated intheir entirety by reference.

BRIEF DESCRIPTION OF THE FIGURES

The invention and the following detailed description of certainembodiments thereof may be understood by reference to the followingfigures:

FIG. 1 depicts an image formation and processing system for renderinghigh quality item images without any background;

FIG. 2 depicts a method of processing images captured with the imageformation system of FIG. 1;

FIG. 3 depicts an alternate embodiment of the image formation facility;

FIG. 4 depicts an overhead view of the image formation facility;

FIG. 5 depicts a section view of the image formation facility;

FIG. 6 depicts a perspective cut away view of the image formationfacility.

FIG. 7 depicts a front view of a semicircular camera support ring;

FIG. 8 depicts a side view of the semicircular camera support ring;

FIG. 9 depicts a perspective view of the semicircular camera supportring with vertical supports;

FIG. 10 depicts a view of a user interface display of an image of anitem that was photographed with the image formation system; and

FIG. 11 depicts various representations of a hand icon that may be usedto manipulate images displayed in the user interface display.

DETAILED DESCRIPTION

An aspect of the present invention involves an image formation andprocessing system 100 for producing high quality images of items so thatthe images contain no visible background or are readily separated fromthe background. An aspect of the image formation and processing system100 includes rendering high quality images of items that are free of allbackground. To render such high quality item-only images, the imageformation and processing system 100 may be adapted to eliminate anyimpact on the uniformity of background illumination such as shadows orreflections cast by the item being photographed.

Film photography exposes a photographic film to all elements within acamera's field of view, thereby recording the item and any visiblebackground on the film. Even small variations in a nearly uniformbackground may be detected and recorded by film photography. Thereforepost processing to separate the item from the background is necessary.To achieve a background-less image in film photography would requirethat only the object be printed on the photograph paper. Because of thefilm exposure process described above, there is no direct equivalent ofa background-less image in film photography.

While also capturing all elements within a camera's field of view,digital photography creates a digital image that can be processedthrough an image processor in which image processing techniques may beapplied to remove the background. One image processing technique mayinclude automatically identifying the outline of the item so that theimage processor can remove image data outside of the item outline (suchdata being the background). The accuracy of outline identification cansignificantly affect the quality and usefulness of the resulting productimage.

The image formation and processing system 100 may combine digital imageformation using the image formation facility 102, camera 122 and lights124, with image processing using the image processor 130 to identify theoutline of an item 128 to a high degree of accuracy. Identification ofan outline of an item 128 may be an automatic process. The imageformation and processing system 100 may further apply image processingtechniques to automatically extract the item 128 data from acquiredimages using the identified outline.

Objects often include complex three-dimensional outlines that may nottransfer well when being captured by a two-dimensional digital cameraimage sensor. This is particularly apparent when a three-dimensionalobject is photographed in perspective view. Also, variations orinadequate lighting may further complicate the distinction of a trailingsurface of the object and its background. By generating consistentlyuniform background illumination, the invention provides images thatallow these complex three-dimensional outlines to be represented assimple sharp contrast changes in a two-dimensional image. Throughoutthis disclosure the phrase “such as” means “such as and withoutlimitation”. Throughout this disclosure the use of “example”, such as in“for example” and “in an example” means an example and withoutlimitation.

Referring to FIG. 1, the image formation and processing system 100 maycomprise an image formation facility 102 for uniformly illuminating anitem 128, a camera 122 for capturing and transferring the image,lighting 124 for illuminating visible surfaces of the item 128, an imageprocessor 130 for processing images, an image library 132 containingimages, and a user display 134 configured for interactively displayingthe item images.

The image formation facility 102 may be comprised of a structuralsupport ring 104 into which a transparent platform 108 is slidablyinserted. The support ring 104 circumferentially captures the platform108 and may form a substantially horizontal surface for supporting androtating the item 128 to facilitate acquiring images of the item 128from a plurality of directions. A light reflection diffusion ring 110may border the structural support ring 104 on the platform 108 toeliminate unwanted reflection of light from the support ring 104. Thelight reflection diffusion ring 110 may prevent non-uniform illuminationby diffusing light reflecting from the support ring 104. Working heightsupport for the structural ring 104 may be provided by a plurality oflegs 112. The legs 112 may further support a curved diffusion backdrop114 through an association with a backdrop frame 118. The diffusionbackdrop 114 may be illuminated to facilitate a uniformly illuminatedbackground for the item 128. The legs 112 may also support a diffusionpanel 120 below and substantially parallel to the platform 108 forproviding uniform light to the platform 108.

When an item 128 is placed approximately centered on the platform 108, aplurality of images of the item 128 may be acquired with the camera 122and transferred to processor 130 for processing and storage in the imagelibrary 132. The camera 122 and lights 124 may be integrated with theimage formation facility 102, or they may be separately supported by astand (not shown), or held by a photographer.

As shown in FIG. 1, a platform 108 may be a clear glass plate. Such aplate may provide a stable, strong surface on which an item 128 may beplaced for photographing. Additionally, a glass plate may provideexcellent light transmission properties to facilitate a uniformlyilluminated surface for photographing an item 128.

In embodiments, the platform 108 may be constructed of light diffusingplastic. In other embodiments, the platform 108 may be a glass platewith light diffusing film applied to one or both sides. In an example ofsuch an embodiment, a non-diffuse light may illuminate the platform 108from below and the platform 108 may diffuse the light. The diffuse lightfrom platform 108 may uniformly illuminate the item 128 from below andthe platform 108 may appear as a substantially uniform white backgroundwhen imaged by a digital camera. Anti-reflective glass may be used forthe platform 108 to reduce reflections. In embodiments, the glass of theplatform 108 may be low iron-glass to reduce reflections.

Polarized light may facilitate acquiring images that enable separationof the item 128 from a background. Polarized light may be provided by apolarized light source or may be provided by polarizing filters disposedbetween the light source and the item 128 and camera 122. To providepolarized light, the backdrop 114 and the glass plate 108 may be wrappedwith a polarizing filter so that light passing through the backdrop 114and plate 108 may be polarized. A second polarized filter may beincluded in the optical system of the camera. When the filter in thecamera optical system is tuned to reject light that is polarized by thebackdrop 114 and/or plate 108, light that passes directly from thebackdrop 114 and the plate 108 to the camera 122 will not pass throughthe camera optical system filter. In this way, the light that makes upthe background for the item 128 will not be acquired by the camera 122.

Polarized light that impacts the item 128 being photographed may scatteras reflected light thereby changing the polarization of the reflectedlight. Because the filter in the camera optical system is tuned toreject only light that matches the polarization of the background light,the light reflected off the item 128 may be acquired by the camera 122because it may pass through the camera optical system filter. Theresulting image acquired by the camera 122 may include only the lightthat is scattered by reflecting off of the item 128. Thus, a camerafilter tuned to filter out light that is polarized by the polarizedbackdrop 114 and polarized plate 108 may facilitate good separationbetween the image of the object (composed of scattered light) and thebackground (composed of polarized light).

The support ring 104 may be formed of steel, aluminum, or other materialthat is sufficiently strong to stably support the platform 108, backdrop114, backdrop frame 118, and item 128. In embodiments, the platform 108is a round disk shaped platform and support ring 104 is a ring with anouter diameter slightly larger than the platform 108. In this example, asupport ring 104 may have a U-shaped profile with the U channelextending inward to capture a portion of the circumference of theplatform 108, thereby supporting the platform 108. The support ring 104may be fastened to the legs 112 so that the support ring 104 and thelegs 112 do not move when the platform 108 is rotated within theU-shaped channel.

To facilitate smooth rotation of the platform 108 within the supportring 104, an intervening material, such as plastic or self-lubricatingnylon may be disposed between the platform 108 and the support ring 104.In embodiments, the support ring 104 provides a user access region 106to a portion of the platform 108 circumference to facilitate rotatingthe platform 108. In another embodiment, the support ring 104 may be “L”shaped so that lower horizontal extension of the “L” supports theplatform 108 from below. In such an embodiment, the intervening materialmay also be used to facilitate smoothly rotating the platform 108.

The legs 112 may be constructed of aluminum, steel, or other materialthat is capable of supporting the image formation facility 102. In theembodiment depicted in FIG. 1, three legs are assembled to support ring104. At least one of the legs 112 may include a leveling mechanism tofacilitate leveling the platform 108. In the embodiment depicted in FIG.1, each leg may include a leveling mechanism to allow adjustment of theplatform 108 to a horizontal position on a variety of uneven surfaces.

The diffusion panel 120 may be constructed of a light diffusing materialsuch as textured plastic and may be assembled to the legs 112. Thediffusion panel 120 may be constructed of glass with a diffusion filmapplied to one or more surfaces. To achieve a high degree of uniformityof light, the diffusion panel 120 may be constructed to deliver a highdegree of haze. Haze is a measurement of wide-angle scattering thatcauses a lack of contrast across the diffusion panel 120. The diffusionpanel 120 may include a light source, such as one or more fluorescentlights below the diffusion panel 120 that enables the diffusion ring totransmit diffused light to the platform 108. The diffusion panel 120 andaccompanying light source may be mounted to the legs 120 at anintermediate position between the platform 108 and the levelingmechanism at the bottom of the legs 112. The diffusion panel 120 may bedisposed within the image formation facility 102 so that only thediffusion panel 120, the item 128, and the backdrop 114 are imaged bythe camera 122. This may be accomplished by extending the diffusionpanel 120 beyond the diameter of the support ring 104. This extensiongenerally may be beneath the platform 108 and support ring 104 in thedirection of the backdrop 114.

The diffusion backdrop 114 may be supported by a backdrop frame 118 sothat the lower edge of the diffusion backdrop 114 is in close proximityto a top surface of the platform 108. In embodiments, the backdrop frame118 may mount on top of support ring 104. In other embodiments, thebackdrop frame 118 construction may include upward vertical extensionsof at least two of the legs 112. In such an embodiment, each of the leg112 may attach to the support ring 104 through a bracket that securesthe support ring 104 to a vertical portion of the leg 112.

The backdrop frame 118 may include horizontal extensions 116 to whichthe diffusion backdrop 114 is attached. In embodiments, the horizontalextensions 116 may be slidably attached to the backdrop frame 118 sothat they may be adjusted horizontally and vertically, and secured inthe adjusted position. Such an embodiment may allow precise positioningof the diffusion backdrop 114 relative to the platform 108 to facilitatea uniformly illuminated background for the item 128.

In embodiments, the bottom of the frame 118 may be constructed like adrum. An inside ring may be wrapped, such as with a white screen, thenpulled tight to form a drum-like structure, then secured by an outsidering.

In embodiments, the platform 108 is supported by legs, which may need tobe reinforced to support heavy objects. In embodiments, a motor assemblymay be used to rotate the platform 108. In embodiments, bearings, suchas air bearings, are used to support the platform 108.

The diffusion backdrop 114 may be curved, similarly to the support ring104. However the curve of the diffusion backdrop 114 may be of a smallerradius than the support ring 104 so that the surface of the backdrop 114facing the item 128 is within the radius of the support ring 104. Thediffusion backdrop 114 may be constructed of a light diffusing materialsuch as textured plastic. The diffusion backdrop 114 may be constructedof glass with a diffusion film applied to one or both surfaces. Toachieve a high degree of uniformity of light, the diffusion backdrop 114may be constructed to deliver a high degree of haze. Haze is ameasurement of wide-angle scattering that causes a lack of contrastacross the diffusion backdrop 114. In embodiments, the diffusionbackdrop 114 may be illuminated. A light source for illuminating thediffusion backdrop 114 may be attached to the backdrop frame 118 or thediffusion backdrop 114. A light source for the diffusion backdrop 114may be one or more fluorescent lights arranged so that when the lightsource is turned on, the diffusion backdrop 114 generates uniform lightintensity and color.

In embodiments, the light source for diffusion backdrop 114 and thediffusion panel 120 may be controlled individually so that each mayprovide the same, similar, or different light intensities and colors.Light for the diffusion backdrop 114 and for the diffusion panel 120 maybe provided by a variety of light technologies including fluorescent,incandescent, LED, electroluminescent, halogen, and such lighting thatmay provide a range of intensity, and may provide a substantially whitelight.

When the diffusion panel 120 and the diffusion backdrop 114 are properlyilluminated, an item 128 on the platform 108 may appear in a photographas having no visible means of support. This may be accomplished by thediffusion panel 120 and the diffusion backdrop 114 providing a uniform,substantially white backdrop for the item 128.

Referring further to FIG. 1, the image formation facility 102 may beconstructed to support and facilitate photographing a wide variety ofitems 128 ranging from small items such as a coin, to large items suchas a high definition Television. The embodiment depicted in FIG. 1 maybe suitable for photographing office and personal electronics productse.g. computers such as desktops, notebooks, tablet PCs, personal digitalassistants (PDA), servers, workstations, fax servers, internet-cacheservers, barebones systems, POS/kiosk systems; monitors & displays suchas CRT monitors, LCD monitors, plasma monitors, projectors; printerssuch as color laser, mono laser, ink-jet, photo printers, multifunctionunits, dot-matrix, plotters, label printers, bar code printers,specialty printers, receipt printers, scanners, point-of-sale printer;software such as antivirus software, business software, developmenttools, education & entertainment, graphics & publishing, internetsoftware, network mgt. software, OS & utilities, security; electronicssuch as digital cameras, film cameras, camcorders, security cameras,games, digital media players, televisions, home audio, home video, homefurniture, GPS, telephony, appliances, office equipment; networking suchas adapters, client, communications, conferencing, hubs, infrastructure,KVM switches, modems, routers, security, software, switches, testequipment, wireless; storage devices such as CD drives, CD-DVDduplicators, CD-DVD servers, DVD drives, fibre channel switches, flashdrives, floppy drives, hard drives, magneto-optical drives, media,network attached storage, removable drives, SAN equipment, storageenclosures, tape automation, tape drives; accessories such as cables,memory, flash memory, power & surge protection, computer components,audio hardware, video hardware, keyboards & mice, batteries, carryingcases, computer accessories, printer supplies, CD-DVD accessories,monitor & display accessories, mounting hardware, camera-camcorderaccessories, PDA accessories, network accessories, projectoraccessories, scanner accessories, computer furniture, phone, cellularaccessories, office & cleaning supplies, and the like.

The image formation facility 102 may also be suitable for facilitatingphotography of a wide variety of other products such as office productsincluding AV supplies & equipment, basic supplies & labels, binders &accessories, janitorial, business cases, calendars & planners, customprinting, desk accessories, executive gifts, filing & storage, paper,forms, envelopes, pens, pencils & markers, printer & fax supplies,promotional products, school supplies; phones & accessories, or otherproducts found in office, school, or home environments, and the like.

The image formation facility 102 may also be suitable for facilitatingphotography of other items such as groceries, produce, cuts of meat,deli products, health and beauty products, clothing, towels, pillows,artwork, models, tableware, collectibles, antiques, potted plants,financial instruments such as bonds, certificates of deposit, currency,and the like. In addition, the image formation facility 102 may besuitable for facilitating photography of humans, such as models.Background-less images of models may be useful in advertising byallowing an advertiser to “place” a model in an advertisement thatincludes any background. In an example, an advertiser may use the imageformation facility 102 to photograph a model and then place the modelinto an advertisement of a sunset taken at a different location.

In general, any item 128 that may remain stable when placed on theplatform 108 within the working volume of the image formation facility102, may take advantage of aspects of the invention that facilitate highresolution photography. In an embodiment of the image formation facility102, the working width may be approximately 72 inches, and the workingheight of the backdrop 114 above the platform 108 may be approximately36 inches.

Items 128 may be photographed within their packaging, partially removed,or fully removed from their packaging to record item 128 unpacking orrepacking for display as an assembly video. Additionally, the packagecontents such as documentation, software, warranty cards, cables,batteries, remote controllers, car chargers, wall chargers, assemblytools, assembly fasteners, loose-supplied parts, anti-static packagingand the like may be photographed.

An item 128 requiring assembly by a user may be photographed at variousstages of assembly, or may be continuously photographed during assemblyto generate an assembly procedure video. Additionally, batteryinstallation, or product installation (such as connecting a power cord,or attaching speakers) may be photographed. By using proper audiorecording equipment, such as may be provided by a digital camcorderembodiment of the camera 122, audio may also be recorded and /orcombined with the assembly procedure video to provide an audiodescription of assembly steps, techniques, benefits, and the like.

An item 128 may be photographed in various states of initialization andoperation. Photographing a user turning on the item 128, inserting aCD-ROM, changing a channel, selecting an item setting (e.g. for audioequipment, audio settings like base, treble, balance, and the like),opening a compartment, closing a compartment, turning off the item 128,and other operation related settings may facilitate a user'sunderstanding of interacting with the product. Such features may includeany features that the user can change, control, or modify.

An item 128 may be photographed from a plurality of angles andpositions. In an example, an item 128 front, back, side, top, or bottommay be photographed. Additionally, an item 128 may be photographed withthe focal plane other than parallel to a surface of the item 128, suchas when the item 128 is photographed with the camera 122 directed at a45 degree angle relative to vertical. A perspective view photograph mayinclude more than one surface of the item 128, such as the front and topof the item or a side and back as if the item were viewed looking towarda rear corner. Perspective views may provide visual confirmation of theshape of the item 128.

Referring to FIG. 1, the camera 122 of the image formation andprocessing system 100 may be a digital still camera. In an example, thecamera 122 may have a resolution of at least 2000×2000 pixels. In otherembodiments, the camera 122 may have a resolution lower than about2000×2000 pixels. It may be understood by one skilled in the art that acamera 122 with any resolution may be used with the image formation andprocessing system 100.

The camera 122 may also provide controls for a variety of settings thatimpact the acquired image. In embodiments, a camera may provide usersettings such as resolution, zoom (optical and/or digital), aperturespeed, f-stop setting, focus, auto exposure, white balance, macro mode,flash operation, and the like. The camera 122 may also includecapabilities which affect performance and quality such as lag time,burst mode for rapid succession (such as video), CCD or CMOS sensor,image storage media (e.g. removable), 24 bit or greater color depth, lowloss or lossless image compression, image output format support forstandards such as JPEG, RAW, and TIFF, and the like. Additional camerafeatures such as interface type (RS232, RS422, parallel port, SCSI, USB,IEE1394, wireless, and infrared), batteries (Alkaline, NiCad, NiMH,LiOn), on screen display, date/time in image, sound recording, software(download, editing), and the like may also be factored into theselection of a camera 122.

Exemplary digital cameras such as Agfa ePhoto, Canon PowerShot, CanonEOS, Casio QV, Concord Eye-Q, Fujifilm FinePix, HP PhotoSmart, JenoptikJendigital, Kodak DC, Konica Minolta DiMAGE, Kyocera Samurai, NikonCoolpix, Olympus E, Pentax EI, Pentax Optio, Polaroid PDC, Premier DC,Pretec DC, Samsung Digimax, Sanyo DSC, Vivatar ViviCam, Yashica Finecam,or a digital video camera such as Canon Elura, Canon Optura, Canon ZR,Hitachi DZ, JVC Everio GZ, JVC GR, Panasonic Proline, Panasonic PV,Panasonic VDR, Samsung SC, SharpViewcam, Sony DCR, Sony Handycam, SonyHDR, Toshiba GSC, and the like may meet one or more requirements for usewith the image formation and processing system 100.

In an aspect of the invention, lighting 124 may be used to illuminatethe item 128 being photographed. Lighting 124 may be coordinated withphotographic settings of the camera 122 to facilitate capture of highquality images of the item 128. In an example, increasing the amount oflight incident on the item 128 may cause the item 128 to washout in theimage unless the camera 122 shutter speed is increased. Faster shutterspeeds may reduce the amount of light that reaches the camera 122 imagesensor, thereby reducing the potential to washout the item 128. Fastershutter speeds may also reduce the amount of light reaching the camera122 from the background. This may facilitate eliminating the backgroundby causing the background to appear black, further enhancing thedistinction of the item 128 from its background.

In embodiments, the lighting 124 source may be one or more strobelights. The actuation phase and duration may be coordinated with thecamera 122 shutter speed and timing in order to facilitate high qualityimage capture. In other embodiments, the lighting 124 may be acontinuous illumination source, such as fluorescent, incandescent, LED,or other continuous illumination lighting technology. For purposes ofilluminating an item 128 to be photographed, the lighting 124 may use aplurality of lights at one or more positions facing the item 128 fromone or more angles such as from the front, top, and sides. The lighting124 may be used to create lighting effects such as shadow, highlights,depth, contrast and other visual effects. Lighting may be white,although other color lights may be used to create color effects. Anycombination of light types, colors, quantities, and positions may beused to illuminate the item 128.

In embodiments, the lighting 124 may be used in combination withillumination from the backdrop 114 and the platform 108 to create a highcontrast image that includes sharp edge definition of the item 128. Thecamera 122 may be configured with settings that facilitate acquiringsuch a high contrast image.

In embodiments, there may be a benefit to changing the camera settingsbetween the camera exposure used to photograph the object and theexposure used to distinguish the object from the background. Camerasettings such as relating to shutter speed and aperture may be adjusted,such as to provide a very high quality image of the object in one case,while providing image contrast between the background and the object inthe other case. Shutter speed and aperture may be adjusted, among otherthings, to account for different lighting conditions, with the objectbeing front lit to obtain a high quality image that will be used forreproduction, and the object being back lit (typically with less light)to obtain a sharp distinction between the image and its background. Inan example, the main image may be shot with a shutter speed of 1/200thof a second at f22, while the backlit image may be shot with a shutterspeed of ¼th of a second at f14. Other combinations may be suitable,depending on the respective lighting conditions for the two shots. Inembodiments the shutter speed and aperture are automatically adjustedbetween shots, such as under control of a computer facility.

In embodiments, the lighting for the backlit image or the primary imagemay be provided by LEDs, such as an array of LEDs for the back lightthat provide even illumination of the background.

Aperture settings may also be adjusted to address depth of field issues.With a small aperture, the lens used to take an image may have a widerdepth of field.

In embodiments, it may be desirable to use the aperture and exposuresettings of the camera to eliminate a low light originating behind orvisible around the item 128. This may be accomplished by reducing thecamera aperture and exposure time to effectively shut out the lowerlight level so that only the front illumination of the item is capturedby the camera. By selecting an effective combination of aperture andshutter speed, it may be possible to get a high quality front-lit imagewith good contrast.

Referring to FIG. 1, the image processor 130 for processing images ofthe image formation and processing system 100 may comprise a generalpurpose computer executing a combination of customized and commerciallyavailable software. In embodiments, the image processor 130 may be apersonal computer executing customized scripts automating AdobePhotoshop image processing software.

The image processor 130 may be a single computer or a network ofcomputers in a client-server configuration. In embodiments, the imageprocessor may connect through a network to other network devices such asthe camera 122, the image library 132, the user display 134, othercomputers, printers, scanners, data storage devices, network bridges,routers, and other computer network devices.

The images acquired by the camera 122 may be transferred to the imageprocessor 130 over a network such as an intranet, Ethernet, or otherdata communication network suitable for image transfer. In an example,the camera 122 may transfer images to the image processor 130 through aUSB port. In another example, the camera 122 may transfer images to theimage processor 130 through an IEE1394 port. The image may betransferred through a wired connection or a wireless connection betweenthe camera 122 and the image processor 130. In embodiments, the imageprocessor 130 may be integrated into the same enclosure as the camera122.

Images may be transferred from the camera 122 to the image processor 130during image acquisition by the camera. Images may be transferredindividually or in groups such as in batch mode between the camera 122and the image processor 130. The camera 122 may have storage capacityfor a plurality of images that may facilitate batch mode image transfer.Images may be transferred automatically upon acquisition by the camera122, by a user directed action, on a predetermined schedule, or as aresult of another action such as a new image being acquired by thecamera 122. Image transfer may adhere to one or more protocols such asPictBridge, WIA, Picture Transfer Protocol, PTP/IP, Media TransferProtocol, and other protocols which facilitate transfer of images fromone device to another.

The image processor 130 may be executing custom software that may becoded in a variety of programming languages such as C, C++, Objective C,AppleScript, JAVA, JavaScript, HTML, visual basic, or a script languagecompatible with a commercial image processing software product such asAdobe Photoshop. The customized software may be embodied in a program, amacro, a script, or other suitable software embodiment.

In an embodiment, the methods and systems disclosed herein may beaccomplished using a computer system that uses an operating system thatsupports a graphical user interface, such as the Apple Mac OS Xoperating system, which includes integrated applications such as Finderfor interfacing with the storage of files and folders, and Xcode whichallows the building of Mac compatible scripts and fully operationalapplications that may act on their own or interact with existingsoftware. In embodiments, Xcode supports developers using C, C++,Objective C, AppleScript, and Java. The Image processor 130 may beprimarily written in AppleScript and JavaScript. These applications mayinterface and run commands between Finder and Adobe Photoshop, where theactual image processing may occur.

The image processor 130 may be executing commercially available softwaresuch as Adobe Photoshop, for example. However other commerciallyavailable image processing software such as Captiva, Tinderbox, Shake,and similar image processing software capable of automation of at leastsome functionality may be used. In embodiments, the image processor 130may execute a combination of commercial software products and customsoftware programs to perform the necessary functions of interfacing withthe camera 122, automatically processing the transferred images togenerate an item-only image, and storing the image in the image library132.

The image formation and processing system 100 may include an imagelibrary 132 containing images processed by the image processor 130. Theimage library 132 may be adapted to facilitate the automated storage andretrieval of item images based on some aspect of the item 128. In anexample, the image library 132 may organize images according to the item128 model number, part number, serial number, vendor code, option, stockkeeping unit (SKU), or other information that easily associates an imagein the image library 132 to an item 128. The image library 132 mayinclude all images acquired by the camera 122 as well as the imagesprocessed by the image processor 130. The image library 132 may beconfigured based on a file system such as NTFS, FAT, HFS+, UNIX, Joilet,and the like. Alternatively, the image library 132 may be configured asa database, such as a Sequel or Access database.

In embodiments, images in the image library 132 may be used for displayor printing and may be repurposed for a specific use by the imageprocessor 130. In an example, one or more images in the image library132 may be presented on the user display 134 for purposes offacilitating a user viewing and learning about the item 128 depicted inthe images. In another example, one or more of the images in the imagelibrary 132 may be provided to a printer for purposes of printing acatalog or other advertisement displaying the item 128 depicted in theimages.

An alternate embodiment of the image formation facility 102 may comprisea motorized means for rotating and tilting the item 128 to automateimage acquisition with a plurality of cameras. In embodiments, a motormay be disposed in various locations to enable movement of the platform108. The example, a motor, a pair of motors, or more motors may belocated underneath the platform 108, on top of the platform 108, or tothe side of the platform 108. In embodiments, a belt may be suppliedaround the platform 108 to reduce friction during movement. Inembodiments, air bearings or other bearings may be used to supportmovement. In embodiments, the motor may have motor control software,which may be integrated with, and under the same control as, thesoftware that may be used to acquire the images of the object held onthe platform 108, such as to cause the motor to rotate the object into adesired position, and then capture the images of the object. Inembodiments, automation software may automate image taking and platformmovement, such as to take a predetermined sequence of shots of anobject.

In embodiments, a mask may be provided inside the camera viewfinder, toshow the area that will be cropped around the object during processingof the image. In such cases, what the viewer sees through the viewfindermay be matched to what will be handled by the image processing software.

FIG. 2 depicts a process 200 of rendering an item-only image 220 of anitem 128 photographed using the image formation and processing system100. The process 200 gains substantial advantage over manual methods byusing aspects of the image formation and processing system 100 thatensure images of items 128 are automatically and quickly produced withconsistently high quality at low cost.

In embodiments, the process 200 may rely on a difference betweenillumination levels within an image to facilitate automatic processingby an image processor 130. The process 200 may involve acquiring atleast two different images from a single perspective. One of the twodifferent images may be acquired with camera settings that facilitateusing the image formation facility 102 to present the item 128substantially in silhouette, thereby acquiring a silhouette image 202.The silhouette image 202 may have very high contrast between a brightbackground and the dark item 128. The very high contrast of thesilhouette image 202 may facilitate the image processor 130automatically and accurately detecting the edge of the item 128 togenerate an edge mask 204. The edge mask 204 may include a set of imagepoints along the visible perimeter of the item 128, wherein the pointsaccurately define a separation between the item 128 and the background.

The other of the at least two different images, a high quality image 208of an item 128 presented by the image formation facility 102 may beacquired by the camera 122 with the assistance of the lights 124illuminating the item 128. While the backdrop 114 and the lowerdiffusion panel 120 may be illuminated moderately to facilitateacquiring the high quality image 208, camera settings such as f-stop maybe different from those used to acquire silhouette image 202.

The edge mask 204 may be superimposed on the high contrast image 208 sothat the edge mask 204 aligns with the item 128. Aligning the edge mask204 with the item 128 facilitates automatically separating the item 128from the background as shown in composite image 210. The image processor130 may automatically extract image content within the aligned edge mask204 from the high resolution image 208 and automatically generate a newimage such as that shown in extracted image 214. The extracted image 214includes only item 128 image content from the high quality image 208.

Edge mask 204 may be an image containing image data which is known tothe image processor 130 as representing the outline of the item 128. Inan example, silhouette image 202, edge mask 204 image, and highresolution image 208 may all be referenced to a common origin point in atwo-dimensional image space. The image processor 130 may combine theimages in the image space to facilitate processing.

Edge mask 204 may be a set of vectors. In embodiments, image processor130 may apply edge mask 204 vectors to the high resolution image 208 inthe two-dimensional image space to separate the item 128 from thebackground of the high resolution image 208.

In other embodiments, image processor 130 may apply other imagealignment algorithms that do not require the high resolution image 208and the edge mask 204 to reference a common origin. Image alignmentalgorithms may include techniques such as pattern matching, edgedetection, or a combination of these and other techniques that generatean accurate alignment of the edge mask 204 to the item 128 of the highresolution image 208.

While the extracted image 214 may be stored in the image library 132, itmay be further processed by the image processor 130 to remove imagedefects, such as dust 212, and image formation defects, such as specularhighlights 218 to generate an item-only image 220. The item-only image220 may be suitable for printing, inclusion in a print catalog, or fordisplay on an electronic display such as a computer monitor.

Image processing software, such as Adobe Photoshop, and many othercommercially available titles, may include image enhancementcapabilities and/or features that facilitate removal of image defectssuch as dust 212 and specular highlights 218. In embodiments, the imageprocessor 130 may include automated scripts or programs that facilitateautomating image enhancement through commercially available imageprocessing software.

Each image-processing step may be manually executed within AdobePhotoshop through user input. The image processing application 130automates the execution of the repetitive tasks in the form of scriptactions to step Photoshop through analyzing each image set. The user mayset or adjust the threshold and tolerance levels Photoshop uses todistinguish between foreground and background information whengenerating the outline mask 204 from the high contrast image 202 priorto batching sequence.

The image processing application 130 may be programmed to automateseveral resizing and cropping procedures that fit the user's needs foreach Web and print-related image set that is being processed. Thesetasks may all be performed using image processing software, such asPhotoshop.

A collection of item-only images 220 from a variety of perspectives ofthe item 128 may be combined in an interactive user display 134 with auser interface adapted for facilitating a user viewing the item 128 fromthe variety of perspectives. The perspectives may include the front,sides, back, top as well as interior views, and various views of theitem 128 in operation, assembly, and packaging. One such perspective mayinclude a user rotating the item 128. Another may include a user openinga door or compartment of the item 128, or turning on/off the item 128.

FIG. 3 depicts an alternate embodiment of the image formation facility302 wherein the lower diffusion panel 120 shown in the embodiment ofFIG. 1 is replaced by a lower diffusion backdrop 320. The lowerdiffusion backdrop 320 may provide diffuse uniform illumination in asimilar way to the diffusion backdrop 114. When the lower diffusionbackdrop 320 and the diffusion backdrop 114 are properly illuminated, anitem 128 on platform 108 may appear in a photograph as having no visiblemeans of support. This may be accomplished by the lower diffusionbackdrop 320 and the diffusion backdrop 114 providing a uniform,substantially white backdrop for the item 128.

In embodiments where image formation and processing system 100 includestwo backdrop sections, such as a main section 114 above the platform 108and a lower backdrop 320 under the platform 108, other techniques may beused to provide smooth illumination at the intersection of the platform108 with the supporting ring 104. In an example, a separate ring ofwhite material may be used to provide increased reflection from thebottom to account for the fact that the platform 108 absorbs some lightfrom the bottom. In other embodiments, a section of the platform 108 maybe painted, such as white or grey, to provide a uniform transition inthe background illumination between the upper and lower backdropportions.

FIG. 4 depicts an overhead view of the image formation facility 302 forpurposes of describing an aspect of the invention related to therelative position of the upper backdrop 114 and the lower backdrop 320.FIG. 4 shows the support ring 104 supporting the frame 118 for thediffusion backdrop 114. It also shows the lower diffusion backdrop 320that is supported by legs 112 (not shown). The support ring 104, lowerdiffusion backdrop 320, and upper diffusion backdrop 114 are allsubstantially concentric. The upper diffusion backdrop 114 has thesmallest effective diameter and the support ring 104 has the largestdiameter. The resulting positioning of the upper backdrop 114 and thelower backdrop 320 may facilitate providing a uniform background to anitem 128 being photographed on the image formation facility 302 byensuring that a top edge of the lower diffusion backdrop 320 is notphotographed. This may be accomplished by the upper diffusion backdrop114 blocking a line of sight between the camera and the top edge of thelower diffusion backdrop 320. A side view of the relative positioning ofthe backdrops can be seen in FIG. 5 and is described below.

The upper diffusion backdrop 114 and the lower diffusion backdrop 320may alternatively form non-concentric arcs. In addition, neitherbackdrop need be concentric with support ring 104. To provide theadvantage of ensuring the top edge of the lower diffusion backdrop 320is not photographed, any arc may be shaped by the backdrops. In anexample, lower backdrop 320 may form an elliptical arc and upperbackdrop 114 may form a circular arc.

FIG. 5 depicts a section view of the image formation facility 302showing a backdrop transition diffusion panel 502 with representativelighting 504 that may be used to illuminate the backdrops. FIG. 5further includes an overhead light 510 that may illuminate the item 128on the platform 108. The lighting 504 in combination with diffusionbackdrops 114 and 320 and in combination with diffusion panel 502 mayfacilitate providing a uniform background to an item 128 beingphotographed. The upper diffusion backdrop 114 is shown mounted offsetfrom the backdrop frame 118 by the frame extensions 116. The frameextensions 116 provide an offset so that the upper backdrop 114 ispositioned closer than the lower backdrop 320 to the item 128 beingphotographed by camera 124.

A diffusion panel 502 may be included with the image formation facility302 to further facilitate providing a uniform background for the item128. The diffusion panel 502 may be positioned so that only diffuselight projects onto a portion of the image formation facility 302 thatincludes the support ring 104, top edge of the lower diffusion backdrop320 and lower edge of the upper diffusion backdrop 114. This may reducethe amount of reflected light from these elements and from any of thestructural elements required to support the backdrops and the platform108 in this portion of the facility 302. The diffusion panel 502 may beconstructed of translucent material much like white office paper,textured plastic, nylon, and other materials that facilitates diffusetransmission of light. The diffusion panel 502 may be mounted to thesupport ring 104 through a transition bracket or frame similar to thebackdrop frame 118.

To provide light to the backdrops, a plurality of lights 504 may bemounted on a light frame 508 behind the image formation facility 302 anddirected toward the diffusion backdrops 114 and 320 and the diffusionpanel 502. One or more of the lights 504 may be controlled individuallyor in combination to provide preferred lighting. An overhead light 510may also be included with the image formation facility 302 to illuminatethe item 128 from above. The overhead light 510 may be mounted to anoverhead fixture, the ceiling, or to the backdrop frame 118. Theoverhead light 510 may be individually controlled or controlled incombination with one or more of the lights 504 or the lights 124 toproperly illuminate the item 128.

FIG. 6 shows a perspective cut away view of the image formation facility302 further providing details of the upper backdrop 114, the lowerbackdrop 320 and the diffusion panel 502. A plurality of upper backdropstabilization rods 602 may be used to provide stability to the backdropframe 118. A stabilization rod 602 may be connected between an upper endof the backdrop frame 118 and the support ring 104. The cutawayperspective view of FIG. 6 shows one of the stabilization rods 602included with the image formation facility 302.

FIGS. 7 through 9 depict a structure and method for maintaining aconstant camera-item distance. In embodiments, the camera 122 may needto be moved about an item 128 while maintaining a constant distance fromthe item 128, to ensure that images taken as the camera is moved aboutthe item 128 have similar levels of illumination. Maintaining a constantdistance may also facilitate generating images that can be sequenced torepresent rotating or tilting the object in an interactive userinterface display. Thus, a semicircular ring or similar apparatus may beprovided that rotates on an axis so that the distance from the camera tothe object is maintained, such as when the semicircular ring is rotatedto put the camera above the object, alongside the object, or somewherein between. FIG. 7 depicts an embodiment of the semicircular ring 702.The camera 122 may be slidably attached to the semicircular ring 702 sothat the camera 122 can move along the surface of the ring 702 tovarious positions for acquiring images.

FIG. 8 depicts the semicircular ring 702 and camera 122 mounted to apartial view of an embodiment of the image formation facility 102. Thesemicircular ring 702 is shown tilting clockwise from an overheadposition 802 to a substantially horizontal position 804. When the motionof the camera 122 as shown in FIG. 7 and the motion of the semicircularring 702 are combined, the item can be viewed from all positions in thequarter-sphere generated by combined motion. In embodiments, thesemicircular ring 702 may be tilted counterclockwise as well asclockwise, thereby facilitating capture images of the item 128 from allcamera perspectives in the hemisphere above the platform 108.

FIG. 9 depicts a perspective view of the semicircular ring 702 andcamera 122 mounted to an embodiment of the image formation facility 102.The semicircular ring 702 is slidably mounted to vertical supports 902to facilitate placing the camera at a variety of distances from the item128.

In embodiments, the position of the semicircular ring 702 and theposition of the camera 122 on the ring 702 may be automatically detectedand transmitted to the image processor 130 so that the three-dimensionalposition of the camera may be associated with each image acquired. Theimage database 132 may receive the camera 122 position information alongwith each image to maintain the camera-item position association. Thismay facilitate automatically generating sequences of images to depicttypes of motion of the item such as rotating, tilting, turning, and thelike. The three-dimensional camera position may also be used tofacilitate identifying the specific image to display on the userinterface display 134 in response to a user requesting an alternate viewof the item 128.

In embodiments, the camera motion along the semicircular ring 702 andthe movement of the ring 702 may be automatically controlled by theimage processor 130 or other computing facility to automaticallygenerate a collection of images from various three-dimensional camerapositions.

It should be noted that the object described herein could be any kind ofobject, including a person or other animate object. In embodiments, theimage formation facility 302 may safely support a person on the platform108 for purposes of acquiring images of the person. In general,acquiring images of inanimate objects do not need to take intoconsideration object movement. However, when acquiring images of aperson, people, or other animate objects, such movement must beconsidered in generating a useful image. In an example, the time betweenthe at least two images used to form an item-only image must be so thatthe effect on the images of movement of the person, people, or otheranimate object may be minimized. Cameras and lighting adapted to supportvery rapid image acquisition may provide the requisite acquisitionrequirements. If camera or lighting settings must be changed betweenimages, automation of these changes may be required in addition to theautomation of acquiring the images.

Aspects of a person that may provide unique requirements for imaging mayinclude the person's hair. Creating an appropriate image boundary oroutline that includes elements as small as a human hair may befacilitated by high resolution imaging and lighting that may providesharp contrast. Since a person's hair also may move between images, theformation and processing system 100 may compensate for this movement bymasking hair so that changes in the hair do not impact generating theitem-only image. In one embodiment, the hair of the high contrast imagemay be replaced by the hair of the detailed image during the generationof the item-only image. Other methods such as image processing, lightingadjustments, masking, and the like for minimizing the impact of hairmovement on the resulting item-only image may also be applied.

In embodiments, it may be desirable to use different kinds of lightbetween images, such as using lights of different color temperature,intensity, color or the like between the two images.

FIG. 10 depicts an embodiment of the user display 134 that may beincluded with the image formation and processing system 100. The userdisplay 134 may be used to display images. In embodiments, the imagesmay be images stored in the image library 132, or images acquired by thecamera 122, repurposed images, images combined with other graphics ortext, web pages containing the images, videos comprising the images, orany combination thereof. The user display 134 may include a userinterface 1002 with features adapted to facilitate a user viewing anitem 128 from a variety of perspectives, angles, operating modes, stagesof unpacking, setup and initialization, and other ways of viewing anitem 128. The user display 134 may be used to display images depictingactivating item controls, observing item visual display features,reviewing item manuals or assembly instructions, displaying video forassembly or operation, and such other images that may facilitateinforming, entertaining, or otherwise satisfying a user preference.

The user interface 1002 of the user display 134 may include a usercontrolled icon or functional pointer that may depict a human hand, suchas hand icon 1004. The hand icon 1004 may be adapted to performfunctions equivalent to touching the displayed item 128, gripping andturning the item 128, opening a compartment of the item 128, depressinga control/button of the item 128 (e.g. with a finger or thumb), andother human-item interactions. In embodiments, the hand icon 1004 maychange appearance to further emulate a human-item interaction. In anexample, as a user positions the hand icon 1004 over a pushbuttoncontrol of the item 128, the hand icon 1004 may depict a human handprepared to depress the button with a finger or thumb. In anotherexample, when a user positions the hand icon 1004 near a dial of theitem 128, the hand icon 1004 may depict a human hand prepared to turnthe dial. User actions through the user interface 1002 such as clickinga button on a mouse may result in the hand icon 1004 depressing the pushbutton or gripping the dial and subsequent movement of the mouse mayturn the dial.

In embodiments the hand icon 1004 may be configured to move or rotate animage of an object. The image may be placed on a grid, such as withcells numbered or lettered to identify particular portions of thescreen. A sequence of movements of the hand icon 1004 may be defined,such as using a script, such as indicating where the hand icon 1004should be placed on the image (e.g., cell A5) and what action should beundertaken by the hand icon 1004 in the interface (e.g., “move to cellA8”, “rotate ninety degrees to the left,” zoom in to one hundred fiftypercent of current image size,” or the like). Thus, the hand icon 1004may be used by an editor to associate a series of movements of the imageon the grid to provide a sequence of different images, such as for apresentation of a product.

In embodiments, the image of the item 128 displayed on the user display134 may change in response to a user action. For example, a user turninga channel select dial on an image of a radio may cause a channel displayon the item 128 to change value thereby representing the response of theradio to a user turning a channel select dial. The change in value ofthe channel display may be accomplished through updating the userdisplay 134 with a sequence of new images of the item 128 from the imagelibrary 132.

These and other user-item interactions may be similarly depicted on theuser display 134 so that a user may get a feel for the item 128 as ifthe user were able to physically interact with the item 128. Inembodiments, the hand icon 1004 may change shape and size in order tomimic the look of a real hand moving a product.

FIG. 11 depicts various changes of the hand icon 1004 for performingadditional human-item interactions. In addition to the types of handicon 1004 changes already described herein, the hand icon 1004 mayfurther include images of a human hand for performing at least thefollowing: zoom functions 1102 such as zoom in by pulling 1104 towardthe user to magnify the item 128, and zoom out by pushing 1108 away fromthe user to de-magnify the item 128; rotation 1110 by gripping andturning to rotate the item 128; spinning 1112 such as to spin a dial orwheel of the item 128; and panning 1114 to move the item 128horizontally or vertically in the user display 134.

The elements depicted in flow charts and block diagrams throughout thefigures imply logical boundaries between the elements. However,according to software or hardware engineering practices, the depictedelements and the functions thereof may be implemented as parts of amonolithic software structure, as standalone software modules, or asmodules that employ external routines, code, services, and so forth, orany combination of these, and all such implementations are within thescope of the present disclosure. Thus, while the foregoing drawings anddescription set forth functional aspects of the disclosed systems, noparticular arrangement of software for implementing these functionalaspects should be inferred from these descriptions unless explicitlystated or otherwise clear from the context.

Similarly, it will be appreciated that the various steps identified anddescribed above may be varied, and that the order of steps may beadapted to particular applications of the techniques disclosed herein.All such variations and modifications are intended to fall within thescope of this disclosure. As such, the depiction and/or description ofan order for various steps should not be understood to require aparticular order of execution for those steps, unless required by aparticular application, or explicitly stated or otherwise clear from thecontext.

The methods or processes described above, and steps thereof, may berealized in hardware, software, or any combination of these suitable fora particular application. The hardware may include a general-purposecomputer and/or dedicated computing device. The processes may berealized in one or more microprocessors, microcontrollers, embeddedmicrocontrollers, programmable digital signal processors or otherprogrammable device, along with internal and/or external memory. Theprocesses may also, or instead, be embodied in an application specificintegrated circuit, a programmable gate array, programmable array logic,or any other device or combination of devices that may be configured toprocess electronic signals. It will further be appreciated that one ormore of the processes may be realized as computer executable codecreated using a structured programming language such as C, an objectoriented programming language such as C++, or any other high-level orlow-level programming language (including assembly languages, hardwaredescription languages, and database programming languages andtechnologies) that may be stored, compiled or interpreted to run on oneof the above devices, as well as heterogeneous combinations ofprocessors, processor architectures, or combinations of differenthardware and software.

Thus, in one aspect, each method described above and combinationsthereof may be embodied in computer executable code that, when executingon one or more computing devices, performs the steps thereof. In anotheraspect, the methods may be embodied in systems that perform the stepsthereof, and may be distributed across devices in a number of ways, orall of the functionality may be integrated into a dedicated, standalonedevice or other hardware. In another aspect, means for performing thesteps associated with the processes described above may include any ofthe hardware and/or software described above. All such permutations andcombinations are intended to fall within the scope of the presentdisclosure.

While the invention has been disclosed in connection with the preferredembodiments shown and described in detail, various modifications andimprovements thereon will become readily apparent to those skilled inthe art. Accordingly, the spirit and scope of the present invention isnot to be limited by the foregoing examples, but is to be understood inthe broadest sense allowable by law.

All documents referenced herein are hereby incorporated by reference.

1. A method for producing a background separated image, comprising:acquiring at least two images of an item and a background with a camera,wherein one of the at least two images includes high contrast betweenthe item and the background, providing a contrast image; processing thecontrast image to detect a separation between the item and thebackground, providing an item edge mask; aligning the item edge maskwith the boundary of the item in the other of the at least two images;extracting the other image content within the aligned edge mask,providing an item-only image; and storing the item-only image in animage library.
 2. The method of claim 1, wherein the background isilluminated.
 3. The method of claim 2, wherein the illumination isuniform. 4-12. (canceled)
 13. The method of claim 1, further comprisingconfiguring a plurality of camera settings for each of the at least twoimages, wherein at least one camera setting is different for each of theat least two images. 14-15. (canceled)
 16. The method of claim 1,wherein the processing includes identifying a set of points of thebackground that is adjacent to a set of points of the item.
 17. Themethod of claim 1, wherein the background of the contrast image issubstantially brighter than the item.
 18. (canceled)
 19. The method ofclaim 1, wherein the edge mask is an image comprising the item boundary.20. The method of claim 1, wherein the edge mask is a list of vectors ina two-dimensional coordinate space.
 21. The method of claim 1, whereinthe edge mask is a list of points in a two-dimensional coordinate space.22. The method of claim 1, wherein each of the at least two imagesinclude a common origin in a two-dimensional space.
 23. The method ofclaim 22, wherein the edge mask includes the common origin so that theedge mask can be automatically aligned to the item in the other image ofthe at least two images.
 24. The method of claim 1, wherein aligning theedge mask includes using an edge detection algorithm to identify aplurality of edges of the item in the other image of the at least twoimages and fitting the edge mask to the detected plurality of edges.25-27. (canceled)
 28. The method of claim 1, wherein providing anitem-only image includes selecting all image content within the alignededge mask, and copying the selected image content to a new image,providing a new image containing only the selected content.
 29. Themethod of claim 1, further comprising removing image defects selectedfrom a set consisting of product surface blemishes, dust, and specularhighlights. 30-46. (canceled)
 47. A system for producing a backgroundseparated image, comprising: a camera for acquiring at least two imagesof an item and a background, wherein one of the at least two imagesprovides high contrast between the item and the background, providing acontrast image; an image processor executing algorithms for processingthe contrast image to detect a separation between the item and thebackground, providing an item edge mask, wherein the edge mask isaligned with the boundary of the item in the other of the at least twoimages, and the other image content within the aligned edge mask isextracted, providing an item-only image; and an image library forstoring the item-only image.
 48. The system of claim 47, wherein thebackground is illuminated. 49-54. (canceled)
 55. The system of claim 47,wherein the background material is light diffusing film on a glasssubstrate.
 56. The system of claim 47, wherein the camera is a digitalcamera. 57-59. (canceled)
 60. The system of claim 47, wherein the imageprocessor is an image processing computer executing a combination ofstandard and customized image transfer and processing software. 61-90.(canceled)
 91. A method of accumulating a set of item-only images of anitem, comprising: providing a camera for acquiring images of an item;providing an illumination fixture for illuminating the item; acquiring aplurality of images of the item from different perspectives, wherein theitem is illuminated by the fixture; automatically processing each of theplurality of images to generate item-only images; and associating theset of item-only images in an image library for presentation to a user.92-103. (canceled)